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ABSTRACT 


This research report contains results of a study on the tse 


computer’s capability of achieving image congruence between temporal 


and multiple images with misregistration due to rotational differences. 


The coordinate transformations are obtained and a general algorithm is 


devised to perform image rotation using tse operations very efficiently. 


The details of this algorithm as well as its theoretical implications 


are presented. Step by step procedures of image registration are 


described in detail. Numerous examples are also employed to demonstrate 


the correctness and the effectiveness of the algorithm.' Conclusions and 


recommendations are made for futher study. 
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CHAPTER 1 


INTRODUCTION 

'The explosion of information has already presented a significant 
challenge to the conventional sequential computers. Especiallys for many 
problems in picture or image processing applications in v^fhich very large 
arrays are required for reasonable resolution, even those "super computers" 
are becoming too small, too slow, or just simply too expensive to use. 

For example, in the 1980*5, as many as 50,000 images are expected to be 
generated per day by Earth Observation type spacecraft. Meteorological 
and planetary spacecraft will increase this number. The need for efficient 
and simple processors which can handle the huge quantity of image type 
data sufficiently fast, at a reasonable cost, is becoming more and more 
urgent. To this end, parallel processing machines [1-4] such as Solomon 
computer and Illiac IV, etc., have been studied for years. However, 
most of them have not reached an operational status because of the 
prohibitive cost involved in their construction. In addition, their 
speeds have never been satisfactory for handling image type data. 

In order to circumvent the challenge of the huge quantity of 
images generated by NASA's spacecraft^;, one research group at Goddard 
Space Flight Center, (GSFC), generated the concept of a new family of 
computers, called "tse computers" [5]. These computers, utilize an 
entire binary image as their basic computational entity, instead of a 
single bit as in conventional digital computers. These computers are 
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two dimensional expansions of conventional computers. Because of 
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■their ability .to perform thousands of operations simultaneously, they 
have the potential of operating orders of magnitudes faster than present 
computers. 

While the processor hardware and its architectural alternatives 
are still under development, the Computer Engineering Group of the 
University of Tennessee has been investigating its capability of 
achieving various image processing problems. An important area of 
remoting sensing is that of achieving image congruence between temporal 
and multiple images of the same region of interest [6,7]. Misregistration 
could result from the inability of the sensing system to produce congruent 
data due to design characteristics or the fact that the sensors are 
separated in space and time such that spatial alignment of the sensor is 
impractical or impossible. Geometric distortion, scale differences, look 
angle effects, and translational and rotational differences between image 
pairs can all combine to produce misregistration. The general regis- 
tration problem Is thus one of determining the location of matching 
context points in multiple images and alteration of the geometric 
relationships of the images such that the registration of each context 
point is achieved. 

The purpose of this study is to investigate the tse computer's 
capability of achieving image congruence betv/een temporal and multiple 
images with misregistration due to rotational differences. The task 
involves the study of the coordinate transformations, the development 
of the registration process using tse operations, the derivation of 
appropriate interpolative techniques, the Identification of the required 
tse operations, and the proposal of possible hardware implementations. 








CHAPTER 2 


COORDINATE TRANSFORMATIONS 

Figure 1 presents an image which is to be rotated clockwise by an 
angle 0 about the tse element (p,q) in the x'y' image plane. In order 
to facilitate the analysis# an equivalent manipulation is one in which 
the image is kept fixed while the x*y‘ image plane is rotated counter- 
clockwise by the same angle 6 to the new position as shown by the dash 
lines. VJith such a viewpoint# four coordinate systems are defined for 
the convenience of the ensuing analysis. From Figure 1-, the coordinate 
systems for an N x N image plane are: 

a) x'y' is a coordinate system associated with the orginal 
image plane in which the tse element at the lower left 
hand corner is the origin; 

b) x"y" is a coordinate system associated with the original 
image plane, but with the rotation center (p#q) as its 
origin (note that the x" and y“ axes are parallel to the 
x' and y' axes, respectively); 

c) x"‘y"* is a coordinate system associated with the rotated 
image plane and has the rotation center (p,q) as its 
origin; and 

d) xy is a coordinate system associated with the rotated 

. image plane, but virith the tse element at the lower left 
hand corner as its origin (note that the x and y axes are 

parallel to the x‘“ and y"' axes, respectively). 
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Figure 1. Coordinate transformations necessary for image notation. 







The coordinate representations In these coordinate systems are 
related by the following set of transformations. 
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Combining these three coordinate transformations in successions the 
relationship between the original coordinates (x*, y') and the final 
coordinates (x, y) becomes 
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or, 


x' = (x - p) cose - (y - q) sine + p 


(4) 


and 


y' “ (x - p) sine + (y - q) cose + q 


( 5 ) 


Only the values at the grid points of the new image plane are of 
Interest. For a grid point {j%k), where j and k are integers, the old 
coordinates (xj a y'j^ ) corresponding to this grid point are from \ 
equations (4) and (5) 


x'-= (j - p) cos 0 - (k - p) sin e + p 

o 


(j - P) sin 0 + (k - q) cos 0 + q . (7) 

Notice that x'^ and y'j^ are, in general, not integers. In other words, 
a grid point in the new image plane is not necessarily at a grid point 
in the original image plane. However, the new grid point {j,k) is in a 
■square formed by four original grid points, namely (m,n), (m+l,n), 

(m,n + l), and (m + l,n + l), as shown in Figure 2, where 


m = [ x'^ ] 


n = [ ] 


and where [] is the notation for the greatest-integer function. The 
significance of these neighboring grid points is that the values at the 
new grid point or (xj can be obtained by Interpolating the 

known values at the original grid points. 











CHAPTER 3 


DATA INTERPOLATIONS 

As presented 1n the previous chapter, the grid points for the new 
image plane are not necessarily at the grid points of the original image 
plane; hence, the values at these points must be obtained through some 
interpolative technique. A large number of interpolative techniques 
based on different criteria and using different numbers of neighboring 
grid points are available. The choice of the technique depends upon 
the resolution and the noise condition of the original .image, as well as 
upon the consideration of computation time and storage. In this chapter 
two techniques are presented which are simple, easy to implement, and 
adequate for most cases. 

Assigning Technique 

The decision as to what value Is assigned to a grid point of the 
new image plane is made dependent on the distance between this point and 
its neighboring grid points in the original image plane. A grid point 
Is assigned the value corresponding to the value of the nearest 
neighboring grid point in the original image plane. Mathematically, 
this may be written as 

f(0,k)=s^^„ (10) 

where f(j,k) is the value to be assigned to the grid point (j,k) of the 

new image plane, and ^ is the knovm value of the nearest original 

grid point. Note that m and n are now defined differently from that in 
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equations (8) and (9). 

rn = <x‘> (11) 

and 

n = (12) 

where <> is the notation for "round-off function". For example, 

<3.4> = 3 and <3.6> = 4, 

The Assigning Technique is the simplest technique for obtaining 
values at new grid points. Fot most of the images which have reasonably 
good resolutions, this technique is more than adequate. In addition, 
the technique has the advantage of not blurring the original image, 

^ Linear Least-Square-Error Technique 

A second approach is to use a linear least-square-error technique [3]. 
As presented in Figure 2, the square formed by the four nearest neighbors 
are used to assign the value of the new grid point. This technique, 
which has a degree of local averaging and does not use an excessive 
number of neighboring grid points in the Interpol ative process, is 
believed to be a very useful interpolative technique in image processing 
problems using tse operations. The interpolation formulae of this 
technique are summarized below, with the details of Its derivation 
presented In Appendix A. 

Let the known values at the four neighboring grid Doints be S 

m,n’ 

^m + l,n" ^m,n-i*l’ ^m + l,n■^l’ ^'sspectively. Then the interpolated 
value at (j,k) is 
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f(j,k) + '^ra+1,n\+l,n ''^m,n + l\,n +1 


^ ''^m + l,n + 1^m + l,n + l 


(13) 


wher-e the W's are weights of the form 


~ + 3/4 

(14) 

^^m + l,n " " Oy/2 + 1/4 

(15) 


“m,n + 1 = + “y/2 + V4 

'^m+l,n + l = + «/2 - V4 

The distances for and ay are shown in Figure 2. Note that the 
linear interpolative technique has the effect of smoothing over the 
four neighboring grid points. 

The two techniques presented above are not the only possible 
interpolative techniques. A large number of more sophisticated 
techniques using a large number of neighboring grid points and associated 
with specific features could be developed. This problem is not explored 
in this research. However, the point to be stressed is that many 
important features such as techniques for noise-stripping, edge and 
curve detection, image restoration, local averaging and image filtering, 

etc., could be incorporated and embedded in the interpolative procedures 
using tse operations. 


CHAPTER 4 


THE INSTRUCTION ROT p, q, 0 

A general instruction for image rotation using tse operations is 
proposed of the form 

POT p, q, 0 

where p»q are the coordinates of the tse element about which the image 
is to be rotated, and 0 is the desired angle of rotation. (A positive 
'>ign is adopted for clockwise rotation of the image.) With this 
instruction as well as the hardware 90°, 180°, and 270° image rotator 
proposed at 6SFC/NASA [5], an image can be rotated about any element for 
any angle. (In fact, the rotation center can be any point, a grid point 
or non-grid point, within the image plane or a point outside the image 
plane.) 

Since the quantities sine , cos e , Xj, y'j,, W's, etc., are not 
integers, all these quantities have to be scaled in order to implement 
the image rotation algorithm with fixed arithmetic. In summary, all the 
equations discussed above, after being scaled by a factor 2^, become 


= (j 

- p) CO'- 0 

- (k 

- q) sin 0 

+ p 

08) 

= (d 

- p) sin 0 

+ (k 

- q) cos 0 

+ q 

09) 


For the Assigning Technique, 
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m = <x'. /2 > 

J 


9 


n = <yV/2*^> , 


f(j.k) = s 


For the linear Least-Square-Error Technique* 


m = [j-j /2>^] , 

n = . 


“x = j - ’ 


“y = y k ■ ’ 


Wm.n = -V2 - “y/2 (3/4). 2' 


V^,n = V2 - y " 


Hn,n+1 = ■" 


Vl.n +1 = - ( 1 / 4 ). 2 ^ 


f(jsk) = W„ S + VI ,n _S « 4 ,tS„ „.l 

in*n iT)*n ni'^'l *n m'^1 *0 nisn’J'l fnan*^! 


■*■ Vl.n+l^m+l.n+l 


f(0,k) = f(j,k)/2’^ . 


tl®EODUCIBILirY OU 

PAGE IS POO 0 



13 


A super bar Is attached to a quantity to denote that the quantity is 

scaled by the scaled factor 2^ (i.e. , x = x*2^). 

Basicallys the implementation of equations (18) through (32) 
using tse operations is straightforward. After the constant planes are 
generated, equations (18) and (19) are computed by at most four 
multiplications and six addition/subtractions. The divisions and 
multiplications which appear in equations (20), (21), (23) through (30), 
and (32) are all powers of 2; hence, expect for the addition/subtraction 
and shift operations, no division or multiplications are actually 
involved in the computations of these equations. The generation of the 
S planes in equation (22) of the Assigning Technique, or in equation (31) 
of the Linear Least-Square-Error Technique, requires a series of slide 
operations. This procedure is very involved and is described in the 


following chapters. 


CHAPTER 5 


magnitude of the slides 

The implementation of the image rotation algorithm requires the 
generation of the S^^„ plane for using the Assigning Technique, or the 
generation of four planes, namely and for using 

the Linear Least-Square-Error Technique, Definitions of m,n in both techniques 
are different in that in the former case, m and n are the "round-off" values 
of x'. and y'|^, respectively , as given in equations (11) and (12), while in the 
latter case, m and n are the "greatest-integer" values of xL and y’^, as given 
in the equations (8) and (9). In spite of this difference, they resemble 
each other in appearance and differ in values by at most one in all cases. 
Therefore, only one technique needs to be discussed in detail. Once the 
problem is solved for this technique, the other case can be solved with 
minor modifications. 

Note that for the Linear Least-Square-Error Technique, the plane 

is the plane in which element (j,k) contains the value originally at the 

element (m,n), which is the old grid point on the lower left side of the 

new grid point (j,k) as shown in Figure 2. Similarly, and 

S are defined in the same manner. The relationships between (j,k) and 

m+1 jn+i 

(m,n) are given in equations (6) through (9), 

Starting with the original image, the plane is generated by 

sliding the value at each point (m,n) to its corresponding point (j,k) 
in a systematic way. With regard to the fact that the image can only 

be slid either horizontally or vertically, the slides are resolved into 
"slide-up (down)" and "slide-right (left)" operations. 

Notice that the new grid points (j,k) and the squares formed by 

14 
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the four neighboring original grid points are not necessarily a 
one-to-one correspondence. For instance, as shown in Figure 3, tv/o new 
grid points, say and may fall into the same square 

formed by the four original grid points; in other words, the point A is 
the (m,n) point corresponding to (a-j,k^) as well as { 52 ^ 9 ^ 2 )* Hence, 
when generating the ^ plane, there is a requirement to slide the 
value at point A to these two neighboring points. On the other hand, 
there is a possibility that no new grid point falls ii -0 a square formed 
by the four original grid points (the square CDEF as shown in Figure 3). 
In such a case, when generating the _ plane, one does not really need 

mall 

the value originally at point C since the point C is not an (m,n) point 
corresponding to any new grid point. Because of the fact that (j,k) and 
(m,n) are not necessarily a one-to-one correspondence and, also, since 
the slide operation itself cannot slide the data at (m,n) exactly to its 
destination (j,k), extraction of data through masks is required to 
complete the generation of the S planes. 

Under the rotation of the angle e, any grid point S(m,n) is 
rotated to a new position S' through the arc SS' as shown in Figure 4. 
This displacement can be resolved in to a horizontal slide and a 
vertical slide The values of and are found to be 

£ = v'^(m-p)^ + (n-q)^ cosltan"^ -0}- (m-p) 

h ^ 

= - (1-cos 0 ){m-p) + (n-q) sin 0 (33) 


and 






( 34 ) 


= 4ra-p)^ + (n-q)^ sin { tan"^ (^) - e} - (n-q) 

.= - (1 - cose)(n-q) - (m-p) sin e 

Since the magnitude of the slides has to be an integer, and also, because 
of the relationships between (j,k) and (m,n) as given by equations (11) 
and (12), the value at (m,n) for the Assigning Technique should be slid 
to the position (j,k) through a vertical slide, 

•V = , (35) • 

and a horizontal slicio, 

H = <V , (36) 

in order to generate 

For the Linear Least-Square-Error Technique, the situation is 
more complicated. Four possible cases for clockwise rotation are shown 
in Figure 5, in which a square formed by four original grid points A,B,C, 
and D is rotated to the new position A'B'C'D'. Figure 5(a) depicts the 
case in which point A is the corresponding (m,n) point of the new grid 
point E; therefore, the relationships between V, H and are 

V = + 1 

and 

H = [4,,] + 1 . 
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Figure 5{b) shows the case In which no new grid point falls into the 

V 

square A'B'C'D'; hence the values of V and H are actually undefined. 

The point A is not an (ihjO) point corresponding to any new grid point. 
When generating the plane, one does not require the value originally 
at point A. Figure 5(c) presents the case in which V and H are given by 

v = [y 

H = + 1 

Figure 5 (d) demonstrates the last possibility, one in which V and H are 

V = [y + 1 

and 

H - [y + 2 . 

Since these situations are so involved, and since the V and H values 
calculated here are only for use in analysis, the above cases are 
approximated by the following unique expressions, with a possible 
difference of magnitude 1. 

V = <Ky> (37) 


where <> is the notation for "round-off function". 

Similarly, for counter-clockwise rotation, the four possible cases 
are shown in Figure 6, in which the values of V and H are 
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V = Uy] +1 

H = 1 

v\ 

> undefined , 

hJ 

V = [iiy] + 1 

H = ® 

and 

V « [a^] + 2 

H * + 1 

These cases can similarly be approximated by the unique expressions 


V = + 1 


(39) 

H = <£^> 

• 

(40) 


Observe that the above three sets of equations, namely equations 
(3^) and (36) for Assigning Technique, equations (37) and (38) for the 
clockwise rotation using the Linear Least-Square-Error Technique, and 
equations (39) and (40) for the counter-clockwise rotation using the 
Linear Least-Square-Error Technique, have exactly the same form. 
Therefore, only one case needs to be presented and discussed in detail; 
hereafter, the derivations for other cases are obtained by minor 
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modifications, 

As i':i consider the S?'* counter-clockwise rotation of a 

25 X 21‘ the tse element (9,9). The values of V and H 

calcuV^;(-.t! -.Tr -/hole plane by equations (33) through (36) are shown 
in Figi. 'f. 7 a'v/ 8, respectively, in which the circled element is the 
rotation :>.iil:er, (9,9). Notice that a positive value of V means a 
slide-up operation, while a negative value of V means a slide-down 
operation. Similarly, a positive value of H means a slide-right 
operation, while a negative value of H means a slide-left operation. 

The lines dividing the V-plane and H-plane into zones are employed for 
the convenience of analysis in the next section. Figures 9 and 10 show 
the V-plane and H-plane of another example, in which the image is 
rotated by a smaller angle (17®). Observe that the zones are wider for 
smaller angles of rotation. 
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CHAPTER 6 


AL60r>nHM FOR THE SLIDE PROCEDURE 

The required horizontal and vertical slides vary from point to 
point in a very irregular manner as presented in Figure 7 and 8. 

However, by dividing the V-plane and H-plane into zones as shovMn in the 
planes, advantage can be taken of the special "sawtooth" patterns to 
devise the following systematic three-step slide procedure to slide the 
data at (m,n) to exactly the position (j,k) or to one of its neighboring 
grid points. Extraction of the data through masks then follows to 
complete the generation of the S planes, as presented in the next 
chapter. 

Step 1. Alignment. Align the pattern by sliding the image 

columnwise. As shown in Figure 11, all elements in the 
same row have the same value 'jf H (that is, require the 
same amount of horizontal slide) after the columnwise 
slides except for a truncation difference with a 
magnitude no more than one. As shown in Figure 12, the 
V pattern also appears to be more regular after this 
step. 

Step 2. Sliding horizontally. Since the H pattern is aligned, 
elements in the same row require the same amount of 
horizontal slide. Rowwise slides are executed in this 
step. As shown in Figure 13, the resulting H plane 
(after row slides) contains only 0, +1, or -1 as 
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:gure 13. H patterns after horizontal slide. Step 2. 



elements, which indicates that all horizontal slides are 
executed vnth the exception that some elements need to be 
slid one more position, left or right. 

Step 3. Sliding vertically . As is proven in Appendix B, the V 
pattern is automatically aligned after Steps 1 and 2; in 
other words, all elements in the same column have the 
same value of V as can be seen in Figure 14, except for a 
truncation difference with a magnitude no more than one. 
This allovjs the slide procedure to be completed by 
sliding the image columnwise. As can be seen from the 
results in Figures 15 and 16, both the H and V planes now 
contain only 0, +1, or -1, indicating that all the (m,n) 
points have been slid to exactly the destination (j,k) or 
to one of its neighboring grid points. With this result, 
the generation of the S planes can be completed simply 
by the "data extraction" technique described in the 
following chapter. 

The important point of the three-step slide procedure is the 
automatic alignment of the V pattern after the second step, which makes 
the columnwise slide in Step 3 possible. 

Observe that the above slide procedure starts with a vertical 
slide (H pattern alignment), follows with a horizontal slide, and 
finally concludes \dth another vertical slide. The roles of horizontal 
slide and vertical slide can be exchanged. In other words, a slide 
procedure could be generated which would accomplish the same result with 
a horizontal slide (V pattern alignment), followed by a vertical slide. 
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and finally, terminated with another horizontal slide. 


CHAPTER 7 


ALGORITHM FOR EXTRACTION OF THE DATA 

In the last chapters the use of a V-plane and a H-plane are 
employed to provide insight into the three-step slide algorithm and to 
demonstrate the success of this algorithm in sliding the data to the 
neighboring grid points of their destination. In a practical application, 
these two planes are not really computed and slid. The only entities 
which are slid are the elements of the image and the coordinates of the 
original grid points. On the other hand, the image is slid to generate 
the desired data plane. The coordinates of the original grid points are 
slid to keep track of the slides and, finally, are used to generate the 
masks as required for the process of extracting data. 

The details of this data extraction technique are explained 
through use of an example. Consider a -37® rotation of a 20 x 20 image, 
with the tse element (0,0) as the rotation center. The desired final 
destination of (m,n) as computed by equations (8) and (9) are shown in 
Figure 17; the original coordinates of (m,n) are presented in Figure 18. 
To generate the S planes, the image is slid by the three-step slide 
procedure. The coordinate plane is also slid at the same time to keep 
track of the (m,n) points. Planes in Figures 19, 20, and 21 show the 
positions of these (m,n) points after Steps 1, 2, and 3, respectively. 
Carefully checking the actual position after the slid procedure in 
Figure 21 against the desired destination in Figure 17, one finds that 
for each desire (m,n) point in Figure 17 its actual position is either 
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Figure 18. Original position. Coordinates. 
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at the exact position A or one of its neighboring grid points, B,C, or 
D, as shown in Figure 22. 

Take the lower left corner portion of the 20 x 20 Image problem 
as an example. From Figure 17, the desired destination is 
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(41) 


and the actual final position after the slide procedure is, from 
Figure 21, 
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Associated with this plane, there is a slid image. 
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where denotes the data which is originally at position (i,j). Now, 


(41) - (42) = 
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The (0,0) elements in the resulting plane indicates that these points 
are at the exact destination. Hence, a mask is generated for these 
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{Slide up and left (43)} • AND • = 


(44) • OR - (45) . OR. (46) . OR - (47) = 
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This is the desired plane. Similarly, 

can be generated by extracting the data through masks in the 


and S ,T ,, 
m+1 ,n+l 

same v/ay. 


Observe that the above example is a special case in which the 


data can always be found from one of its four neighboring grid points, 
after the slide procedure, as shown in Figure 22. In general, however, 
as proven in Appendix B and presented in the examples of the next chapter, 
data can be at any one of its eight neighboring grid points as depicted 
in Figure 23. In other words, nine masks, instead of four, are required 
to extract the data and generate the desired S planes, 
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CHAPTER 8 

AUTOMATIC CONTROL FOR THE SLIDE PROCEDURE 

A control unit Is required for the tse computer to undertake the 
task of sequencing the stored instructions in the proper order, selecting 
the correct information source and destination, and providing the 
appropriate processing path through the tse processor. "One possible 
control organization is shov/n in Figure 24 [sls in which processor 
control is achieved by the selection of a "control word" which is output 
from the control unit and interfaced with the tse processor. Each bit of 
the control word is used to activate or deactivate one or more of the 
elements in the tse processor. Proper data paths are thus provided by 
activating the elements v/hich lie in the specific processing paths 
chosen by the Instruction. 

Control implementation may be achieved by utilizing small computers, 
Basically, any of the microprocessors available could be used. However, 
the control unit must observe the timing constraints dictated by the tse 
logic device propagation delay. A control unit organized around a micro- 
processor must be sufficiently fast for the tse processor. 

Most of the operations involved in the image rotation algorithm 
are simple slides, shifts, additions, subtractions, and comparisons, etc.. 
The function of the tse processor control unit for these basic operations 
has been studied [2,4] and is not duplicated in this research. However, 
since a large number of slide operations is required in the three-step 

slide procedure, an efficient control algorithm for the slide process is 
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highly necessary. 

The task of the control unit in the three-step slide procedure is 
to accurately determine the desired number of slides for each column, or 
each row, at each step. Notice that, in the actual implementation of the 
algorithm, V and H planes are not generated and slid for the following 
two reasons: 

(1) As presented in Chapter 5, the exact relationships betv/een V, 

H and 2.^, are involved. 

(2) Even if the V and H planes were generated and slid along with 
the image for the purpose of providing useful guides, the task' 
is very time-consuming to determine the proper amount of slides 
for each column (row) at each step by the man-machine mode, as 
was done in Chapter 6. The development of a hardware sensor or 
a software algorithm to check the V and H planes and to 
determine the required number of slides would be very impractical 
as far as cost and operation time are concerned. 

Therefore, there is no obvious guide from which one can decide upon the 
required number of slides during the slide process. For this reason, an 
algorithm which can provide the control unit with the necessary information 
on the required slides for each row, or each column, at each step of the 
sliding process, is desirable. The efficiency of such a control is crucial 
to the success of the image rotation. 

The follov/ing text is devoted to the development and the explanation 
of a method serving for the automatic control of the slide procedure. This 
method is simple, fast, and easy to implement. The number of required 
slides for each column, or each row, can be precalculated and coded as 

REPRODUCIBILnY OF THE 
ORIQGSrAL PAGE IS POOH 
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control words before the execution of the sliding procedure. An example 
Is employed to illustrate the details of the proposed method. 

Step 1 . 

As presented in Appendix B, the amount of vertical slides generated 
in this steps for column m, is 


V’ 



cose - 1 
sine 


(m-p) / 


(48) 


where e is the angle of rotation and p is the x-coordinate of the 
rotation center. As an example. Figure 25 shows a 32 x 32 image plane 
which contains a binary image "T’S whose edges are outlined as shown in 
the figure. The image is to be rotated 37-. 24° about the tse element 
(15,15), as shown by the circled element. The Assigning Technique is 
used in this example. 

Equation (48) becomes 

" ^'^sL^ 37.24” (m-15)^ = <^0,337(m-15)^ 

The amount of vertical slides for each column can be calculated by the 
control unit, by substituting m = 0 to 31. The results are shown in 
Table 1. 

Figure 26 showns the image after performing the vertical slides. 
As expected. Step 1 has the effect of twisting the image vertically. 

Step 2 

The horizontal slides in Step 2 are given by Equations (33) and 
(34), or any set of equations (35) and (36), equations (37) and (38), or 








TABLE 1 


a 

0 

Amount of Vertical Slides in Step 1 

u 


m 

V* 

m 

v' 

V 



0 

5 

16 

0 

1 

5 

17 

-1 

2 

4 

18 

-1 

3 

4 

19 

-1 

4 

4 

20 

-2 

5 

3 

21 

-2 

6 

3 

22 

-2 

7 

3 

23 

-3 

8 

2 

24 ’ 

-3 

9 

2 

25 

-3 

10 

2 

26 

-4 

1 

; ! 11 

1 

27 

-4 

12 

1 

28 

-4 

13 

1 

29 

-5 

14 

0 

30 

-5 

; : 15 

0 

31 

-5 
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equations (39) and (40), depending upon which technique is used and in 
which direction the image is rotated. In Step 1 , the H-pattern is 
aligned with respect to the elements at the same coluitin. as the rotation 
center. Since this column is the only column which is not slid during 
Step 1 , the simplest way to determine the required number of horizontal 
slides fqr each row is to use these elements as references. Substituting 
the coordinates of these elements (p,n) into equation (33), and then into 
equations (35), (37), and (39), the following results are obtained: 

(1) For the Assigning Technique, 

H = <(n-q) sine> , (49) . 

(2) For the Linear Least-Square-Error Technique (clockwise 
rotation, - 

H = <{n-q) sin0> + 1 (50) 

(3) For the Linear Least-Square-Error Technique (counter-clockwise 
rotation), 

H= <(n-q) sine> (51) 

For the example, equation (49) becomes 
H = <(n-15)-sin 37,24> 

= <0.605 .(n-15)> 

The amount of required horizontal slides for each row calculated by this 
equation are summarized in Table 2. 


TABLE 2 


Amount of Horizontal Slides I’n Step 2 


H 

n 

H 

■ -9 

16 

1 

-8 

17 

1 

-8 

18 

2 

-7 

19 

2 

-7 

20 

3 

-6 

21 

4 

-5 

22 

4 

-5 

23 

5 

-4 

24 

5 

-4 

25 

6 

-3 

26 

7 

-2 

27 

7 

-2 

28 

8 

-1 

29 

8 

-1 

30 

9 

0 

31 

10 
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The result of the image slid by the algorithm is shown in Figure 
27, As can be seen. Step 2 has the effect of twisting the image 
horizontally. 

Step 3 

Since almost all image elements are displaced from their original 
positions after Steps 1 and 2, there is no obvious row or column similar 
to the p-column used in Step 2 which can be employed as the reference for 
the decision of the required vertical slides for each column in Step 3. 

The .intended reference elements, after being slid in Steps 1 and 2, must . 
span the whole range from the leftmost column to the rightmost column 
such that the required number of vertical slides for each column can be 
determined from the reference elements at that column. After thorough 
study, the elements on the diagonal of the image plane are found to be 
the only set of elements which has the above property in all cases. These 
points are indicated as underlined elements in Figure 25. Their new 
positions after Steps 1 and 2 are shown In Figures 26 and 27, respectively. 
Notice that, although some of these elements are slid out of the image plane 
during Steps 1 and 2, the remaining elements cover the whole plane 
horizontally. Also, observe the fact that reference elements are absent in 
some columns, which can be taken care of by filling appropriate data 
into these positions. Since the number of absent elements is small, no 
difficulty is imposed by this condition. 

The task of determining the required number of slides in Step 3 
includes: 


(a) Determining the new column positions of the reference elements after 
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Figure 27, Slide image after Step 2. 
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Step 2. 

The column position of the diagonal element {n,n), after a 
horizontal slide H in Step 2, is 

i = n + H (52) 

where H is given by equations (36), (38), or (40), depending upon which 
interpolative technique is used and in which direction the image is 
rotated. 

For the example, equation (52) becomes 

■i =n + <-(l-cos 37.24°)(n-15) + (n-15)sin 37.24‘^> = n +' <0,4(n-15)> 

The calculated values of new column positions i are shown in Table 3(a). 
Those elements which are slid out of the image plane (1 < 0 or i > 31) 
are no longer considered and are deleted in the table. Observe that, for 
n = 14 and 16, the calculated values of 1 are 14 and 16, respectively, 
which are different from the actual column positions of these two elements, 
13 and 17, as can be seen from Figure 27. However, these differences 
are always no more than 1, and are within the tolerance of the algorithm 
for data extraction. 

(b) Determining the required number of vertical slides in Step 3 for 
reference elements. 

The total number of required vertical slides, V, for the diagonal 
element (n,n) is given by equations (35), (37), or (39), Since the 
element has already been slid by an amount V in Step 1, the required 
vertical slides in Step 3 is 
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V*' = V - V* , (53) 

where V is given by equation (48). 

For the example , equation (53) becomes 

r = <-(] - cos 37.24°) (n-15) - (n-15)sin 37.24‘>> - ~J fn-iBK 

sin 37.24° 

= <-0.809 (n-15)> -<-0,337 (n-15)> , n = 4 - 26 

The values of V" calculated by this equation are shown in Table 3(b). 

Notice that for some i. the values of V are not given, since reference 
elements are absent at these columns. 

(c) Smoothing V" 

For clockwise rotation, V" should be a decreasing function of 
column i. However, as indicated in Table 3(b), contradiction occurs for 
i = 6 as a result of rounding-off. Data smoothing is thus required to 
make the corrections. One of the simplest ways to restore V" to a 
decreasing function is the operation 

V“(i+1) = r(i) , if r(i+l)> V"(i) . (54) 

The results of the smoothing operation are shown in Table 3(c). 

(d) Filling the voids in V" 

Since the voids in V" are few and are distributed evenly among the 
specified ones, each void can be filled by simply assigning the void the 
same value as the column to its left; that is. 
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TABLE 3 


n 

1 

i 

V" 

♦ 

V" 

0 
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5 
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14(13) 

14 
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(a) The New Column Positions of The Reference Elements After Step 2 

(b) Required Number of Vertical Slides For Reference Elements 

(c) Results of the Smoothing of V" 

(d) Results of the Filling of V" 
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V"(i+1) = V”(i) j 1f V"(1+l) is not given . 


The final results of V" after the filling process are shown in Table 3(d). 
After sliding the image by the amounts determined in Step 3, the results 
are shorn in Figure 28. Step 3 has the effect of twisting the image 
further vertically. 

Notice that the above discussion for Step 3 is only for a clockwise 
rotation. For counter-clockwise rotation, the following two operations 
are' changed; 

(1) Diagonal elements {0,N-1), (l,N-2), (N~1,0), instead 

of (0,0), (1,1), (N-1,N-1), are used as reference 

elements; 

(2) The V" should be an increasing function, rather than a 
decreasing function of i. 

Finally, the detailed algorithm for making the decision as to the 
required number of slides in each step are summarized in Table 4. 
Different formulae are included for both interpolative techniques, and 
both directions of rotation.' The step by step procedures are presented 
in such a way that direct implementation of this algorithm is not 
difficult. 
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Figure 28. Slid Image after Step 3, 



TABLE 4 

Steps to Perform the Three-Step Slide Algorithm 


Assigning Technique 


LLSE Technique 



clockwise 

rotation 

counter-clockwise 

rotation 

clockwise 

rotation 

counter-clockwise 

rotation 

Step 1 


^COS0 - 



V (m; - 


sin 0 

im-p; > 


5t6p 2 
H(n) = 

<(n-q) sine> 

<(n-q) sine> + 1 

<(n-q) sine> 

Step 3 
(a) 

i(n) = 

j 

n + <-(l-cosS)(n-p) 
+ (n-q) sine> 

n + <- (1 -cos0)(n-p) 
-{N-l-n-q) sine> 

n + <-{l-cos0)(n-p) 
-{n-q) sine> 

n + <-(l-cos 0 )(n-p) 
"(N-l-n-q) sine> 

(b) 

V"(i) = 

<-(l-cos0)(n-q) 
-(n-p) sin‘ 0 > 

<“(l~cos0)(n-q) 
-(N-1-n-p) sin0> 

<-(l-cos0) (n-q) 
-(n-p) sin0> 

<-(l-cos0)(n-q) 
-(N-l-n-p) sine> + l 

(c) 

Smoothing 

V"(i+1) = V"(i) 
if V"{i+l)>V"(i) 

V"(i+1) = V"(i) 
if V"(i+l)<V"(i) 

r(i+i) = V"(i) 

ifV"(i+i)>V"(i) ■ 

V"(i+1) = V"(1) 
if V"(i+i)<V"(i) 

(d) 

Filling 


V"(i+1) = V"(i) 

if V“(i+1) is not g 

iven 
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CHAPTER 9 


EXAMPLES 

In this chapter, many examples are given to demonstrate the 
correctness and the effectiveness of the algorithm derived in the previous 
chapters. Various cases. Including clockwise rotation and counter- 
clockwise rotation, small angle rotation and large angle rotation, 
rotation about a point in the middle of the image plane, rotation about 
a point close to the boundary of the image plane, using the Assigning 
Technique and using the Linear Least-Square-Error Technique, are presented 
in order to show that the algorithms are applicable to all cases of 

$ 

rotation. The 32 x 32 image plane shov/n in Figure 25 (page 55)is used 
for the examples. All examples are simulated using FORTRAN language on 
an IBM/360 System. The simulation program, which is developed for the general 
case, is included in Appendix C, One should make the point that because 
of the printing facility used, the Images shown in the following examples 
do not appear to be exact squares as they should be. Except for this 
print-out distortion, the results of all examples appear to be what one 
would expect. 

Example 1 

rotation center (p,q) = (8,4) 
rotation angle e = 28,6^ 

The Assigning Technique 

As the first step, the desired destinations, m and n planes, are 

calculated by equations (6), (7), (11), and (12), and shown in Figures 29 

68 








69 . 

and 30, respectively. The three-step slide algorithm- is then used to 
slide the image 35 well as the original m and n planes, which are the 
coordinates of the tse elements as shown in Figures 31 and 32. The image 
after each slide step is shown in Figures 33, 34, and 35, As expected. 

Step 1 has the effect of twisting the image vertically and Step 2 has the 
effect of testing the image horizontally, Step 3 completes the remaining 
vertical slides. The result in Figure 35 shows that, after the slide 
procedure, the image has been rotated to the desired orientation, but its 

edges are rather coarse. 

Notice that the original positions, m and n planes, which are 
shown in Figures 31 and 32, are slid along with the image plane. Figures 
36 and 37 present the ra and n planes after the slide procedure. Comparing 
the calculated ra and n planes (Figures 29 and 30), which show the desired- 
destinations; with the slid m and n planes (Figures 36 and 37), which show 
the actual positions after the slide procedure, data can be extracted by 
the algorithm described in Chapter 7 to form the desired rotated image 
f(i, 0 ), as shown in Figure 38. Observe that this image has smoother 
edges than the one in Figure 35. The data extraction process has 
rearranged the displaced elements and positioned them where they should be 

Careful comparison of Figures 29, 30 and Figures 36, 37 reveals 
that the boundaries of the calculated m, n planes and those of the slid 
ra,n planes are not exactly the same. The differences are due to the 
round-off approximations. Even though this "boundary effect is small, 

one should be aware of its presence. 

In the actual implementation, elements slid from outside the image 
plane are presented by O's rather than stars as shown in Figures 33 
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Figure 32, Original n. 
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Figure 33, Slid image after Step 1 
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Figure 34, Slid image after Step 2. 
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Figure 35, Slid Image after Step 3 




Figure 36. Fin^l m (slid). 
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Figure 37. Final n (slid). 
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Figure 38. Rotated Image f{i,j). 
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through 38. The actual boundary of the rotated Image. can be obtained by 
generating a mask from the calculated final m and n planes, as shown in 
Figures 29 and 30, where elements with coordinates less than 0 or greater 
than 31 are the area originally undefined. 

Example 2 

rotation center (p»q) = (8>4) 
rotation angle e = -28.6® 

The Assigning Technique 

This example is the same as Example 1, except that the image is 
rotated in a counter-clockwise direction. The rotated image ^'s presented 
in Figure 39, Observe that some elements on the boundary of the rotated 
image plane (for example, the squared element on the left boundary in 
Figure 39) do not obtain the data from its neighboring elements (Obviously, 
the value at the squared element should be 1 rather than 0), This is 
because of the fact that, for boundary elements, some of their eight 
neighboring elements have already been slid out of the image plane; 
therefore, the task becomes impossible for these boundary elements to 
extract the required data from lost elements. As a result, one should 
realize that the boundary of the rotated image has already deteriorated. 

Example 3 

rotation center (pjq) = (8,4) 
rotation angle e = 28,6° 

The Linear Least-Square-Error Technique 

This example is the same as Example 1, except that the Linear 
Least-Square-Error Interpolative Technique is used to extract data. 
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Figure 39. Example 2: (p,q) = (8,4), 


0 - -28,7° (Using Assigning Technique) 
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Figure 40 presents the ^ plane. Image planes ^m,n+r 

^m-M n+1 similarly be generated and the final rotated image can be 
obtained by interpolating these four planes. Howevers since the image 
in this example is only a binary image, the effort is not taken. 

Example 4 

rotation center (p^q) = (8,4) 
rotation angle e = -28.6^ 

The Linear Least-Square-Error Technique 


Again the Least-Square-Error Interpolative Technique is used to 

replace the Assigning Technique used in Example 2. The resulting S„ 

iTi 5 n 

plane Is presented in Figure 41. 


Example 5 

rotation center (p^q) = (15,15) 
rotation angle e = 45° 

The Assigning Technique 


The rotated image f(i,j) Is presented in Figure 42. 


Example 6 

rotation center (p,q) = (15,15) 
rotation angle e = 10° 

The Assigning Technique 


Figure 43 presents the rotated Image. Observe that since the 
rotation angle is small and the image is a binary image, the rotated 
image looks rather crude. 
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Figure 40, Example 3: (p,q) = {8,4', e = 28,7° (Using Linear Lea'^t-Square 

Error Interpol ative Technique). 
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Figure 41 , Example 4 : (p.q) = ( 8 , 4 ), 8 = - 28 . 7 “ (Using Linear Least- 
Square-Error Interpolative Technique). 
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Figure 42, Example 5: (p,q) = (15,15), e = 45° (Using Assigning 

Technique), 
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Figure 43. Example 6: Cp.q) = (15,15), e = 10° (Using Assigning Technique). 
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Example 7 


rotation center (p,q) = (15,15) 
rotation angle 0 = 5'* 

The Assigning Technique 


The rotated image is presented in Figure 44, 


Example 8 


rotation center (p,q) = (15,15) 
rotation angle e =-15^ 

The Assigning Technique 


Figure 45 shows the rotated image. 

Example 9 

roLption center {p>q) = (31,0) 

rotation. angle e .= 10‘'* 

The Assigning Technique 

In this example, the image is rotated about the lower right corner 
of the image plane. The final image Is presented in Figure 46. 


Example 10 


rotation center (p,q) = (0,31) 
rotation angle a = -15° 

The Assigning Technique 


The image is rotated about the upper left corner of the image 
plane. Figure 47 presents the rotated image. 


Example 11 


rotation center (p,q) = (31,31) 
rotation angle o = 10° 

The Assigning Technique 
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Figure 45. Example 8;(p,q] = (15,15), 6 = -15° (Using Assigning Technique). 
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Figure 46, Example 9: (p,q) = (31,0), e = lO'* (Using Assigning Technique), 
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Figure 47. Exa.nple 10. (p,q) = (0,31), 0 = -15" (Using Assigning Technique). 


The image is rotated about the upper right corner of the image 
plane. Figure 48 presents the rotated image. 

Example 12 

rotation center (p^q) = (0^0) 
rotation angle = 5° 

The Assigning Technique 

The image is rotated about the lower left corner of the image 
plane. Figure 49 presents the rotated image. 
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Figure 48. Example 11: (p,q) = (31.31), 9 = iQo (using Assigning Technique) 









*^:^: 3 } tj } c # 0 

•Ijtiiciitifiilft 0 
*#*# 0 0 
0 0 
sf ::^ e ** 0 0 

0 0 
0 0 
:^ e 5 ^ e 3 } c # 0 0 

0 0 
0 0 
sft3{c:5e# 5 0 

0 0 
0 0 
0 0 0 

0 0 0 

*#000 
**000 
**000 
**000 
**000 
**000 
**000 
**000 
**000 
**000 
0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

@0 0 0 


Q****************************************************** 
0 0 0 0******'**************’*'*****’''****’^******’^********* 
00000000000000 o********’®'****’®'**’^********’^ 
0000000000000000000000000 0 **** 
0000000000000000000000000000 
0000000000000000000000000000 
000000000 Q 0 O 0_Q 0 0000000000000 


0000 0 0 0 0 Q Q 0 QO_Q 
0 0 0 0 n I I I I 1 I I 1 1 


ooooiiLiiiiiiiii ~r V i L "iri i no o o o 

OOOOllllllllllllllllllllOOOO 
OOOOllllllllilllllllllllOOOO 
0 0 0 0 11 1 1 1 I 1 1 lllllllllllilOOOO 
00000000 0 0^ I 1 I I I llllIIllJ 0 0 0 0 
0000000000 of I 11 1 Ifo 0 0 0 0 0 0 0 0 0 0 0 
ooooooooooofiiiiyoooooooooooo 

0000000000/11 ll 1 /0000000000000 
0000000000(11 11 1(0 000000000000 
000000000 01 111 llo 000000000000 


0 0 0 0 Q 0 0 q 0 0 0 0 

Till iri I i^o 000 

llllllllOOOO 

lllllllLOOOO 

llllllllOOOO 

1 I I 1 I 1 1 ij 0 0 0 0 

"0 0 0 0 0 0 do 0 0 0 0 
000000000000 
000000000000 


OOOOOOOOOOllll 
000000000011 11 
OOOOOOOOOOllll 
OOOOOOOOOOllll 
OOOOOOOOOOllll 
OOOOOOOOOOllll 
OOOOOOOOOOllll 
0000000000/11 11 
00000000 on i i i i 
00000000 oil I 1 1 I 

00000000 Oil 1111 
00000000 0 0 0 ^00 


lllOOOOOOOOOOOOO 
lllOOOOOOOOOOOOO 
lllOOOOOOOOOOOOO 
lllOOOOOOOOOOOOO 
lllOOOOOOOOOOOOO 
lllOOOOOOOOOOOOO 
lllOOOOOOOOOOOOO 
lllOOOOOOOOOOOOO 
111 ! 0000000000000 
11/00000000000000 
I IJ O 0000000000000 
(T7) 00000000000000 


0000000000000000000 0 00000000 
0000000000000000000000000000 


Figure 49. Example 12. (p,q) = (0,0), 9=5° (Using Assigning Technique) 





CHAPTER 10 
IMPLEMENTATION 

The slide procedure Is the crucial step in the image rotation 
problem. Special hardware is required to facilitate the fast execution 
of the slide process, A simple and efficient hardware structure is 
proposed in this chapter. Such an organization can be easily incorporated 
with the tse computer architectures previously proposed [8,9,10]. 

As an example. Figure 50 presents a 5 x 5 image plane, in which 
columns 2 and 3 need to be slid upward one position, columns 4 and 5 need 
to be slid upward 2 and 3 positions, respectively, Obviously, sliding 
the image plane column by column would be very inefficient as far as 
operation time is concerned. For this example, 1+1 +2 + 3 = 7 slide 
operations would be required. In addition, a mask for each column is 
also required. The slide procedure for the image plane can be resolved 
tnto three steps as shown in Figure 50. Since each column, with the 
exception of column 1, requires at least one vertical slide, a mask is 
used to slide the part of the image to the right of column 1 one position. 
Similarly, since the image to the right of column 3 needs at least 
another vertical slide, another mask, which can be obtained by sliding 
the mask in step 1 right two positions, can be used to slide columns 4 
and 5. This same procedure holds true for Step 3, Observe that, in such 
a procedure, only 3 vertical slides are required. In general, the total 
number of slides is equal to the maximum number of slides required for 
any column, as compared to the sum of the slides required for each column 














95 



y, < ^ y!. ^ 


r-“ 

t— 

t— 

r*“ 

r-" 

O 

o 

o 

o 

O 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 

o 


% yC ^ ^ 

^ K '>< -iC 

^ V ^ 

'jC -A y(. < < 


y. yC. -< < < 

y. ^ M ^ 

'iC yi '•i 

y. < •< < ^ 

% ^ ^ 


ng using masks 















by a columnwise slide. The horizontal sliding of the Image can be 
accomplished In a similar way, 

A simple hardware organization which can efficiently execute the 
slide procedure for the above algorithm Is proposed in Figure 51, The 
functional capabilities of this implementation are described below. 

The Mask Generator is used to generate successively the necessary 
mask for the slide operations. Initially, an all I’s tse is loaded, 
which Is then slid vertically (for horizontal sliding of the image) or 
horizontally (for vertical sliding of the Image) to generate a series of 
masks. The mask and its complement are output to the image Slider, 
where the Image and Its coordinates are slid tse by tse through the 
action of these masks. 
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CHAPTER n 
CONCLUSION 


The coordinate transformations involved in the image rotation 
problem have been generated. General algorithms are proposed to perform 
image rotation using tse operations. Two simple and useful Interpolative 
techniques have been developed. Various examples have been employed to 
demonstrate the correctness and the effectiveness of the proposed 
algorithms. By utilizing the hardware Implementation of Figure 51, the 
lengthy slide procedure can be accomplished speedily and efficiently. 

The algorithms of the three-step slide procedure and data 
extraction are essential to the problem. Their derivations are Intended 
to be based upon as rigorous a mathematical treatment as possible. These 
developments have provided a successful solution to the Image rotation 
problem. However, the method for the automatic control of thesllde procedure 
has not been fully explored. The following subjects are recommended for 
further study. 

Additional Simulations and Possible Refinements of the Proposed Control 
Method 


Because of the experimental nature of tlie Image rotation problem 
due to many round-off approximations in the derivations, a large number 
of simulation results should be generated to confirm the correctness of 
the proposed control method. Although many examples are employed in 
Chapter 9, most of these are simulated for the Assigning Technique. At 
most, one concludes that the proposed control method is successful for 
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the cases using the Assigning Technique. However, the proposed control 
method has not been tested extensively for the cases using the Linear 
Least-Square-Error Interpolalive Technique, The proposed control method 
may not be accurate enough to be suitable for all cases. For instance, 
the smoothing and filling of V from the left may underestimated the 
complexity of the problem and thus may result in the failure of sliding 
some elements to one of their neighboring elements in some cases. These 
operations need to be tested extensively and refined, if necessary, to 
provide an accurate procedure. The procedure developed in this research 
has been successful in all cases tested. 


Alternatives to the Proposed Control Method 

Since the instruction cycle time of a conventional computer 1s 
significantly less than that of the tse computer, a control unit organized 
around a microprocessor is sufficiently fast for the computations of vhe 
required number of slides in the three-step slid procedure. Sooner or 
later, the instruction cycle time of the tse computer might become 
compavative with that of a conventional computer. In this situation, 
the microprocessor control of sliding may be too slow, A task should be 
initiated to determine if the control of the sliding can be accomplished 
within the tse processor itself. 
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Figure A shows the grid point (j,k), or (x’j,y'|^), of the new 
image plane and its four neighboring grid points. The value at the grid 
point is unknown and needs to be determined through some interpolation 
technique. A linear interpolation technique using four neighboring points 
is derived here, based on the "least squared error" criterion. 

in this technique, the value at (xt ,y'^ ) will be determined 
through the linear interpolation over its four neighbors to satisfy the least- 
square-error condition. In other words, the plane which fits the four 
points with the least squared error will be found. Then, the interpolation 


value at (x'j,y'i^) can be determined. 

Let the known values at the four grid points (m,n), (m+l,n), (m,n+l), 


and {m+l,n+l) be 

the equation of the linear interpolation plane be 


, respectively, and let 


f(x',y') = a(x' - m) + b(y' - n) + c , 


(Al) 


Note that the summed squared error is 

e^ = [f (m,n) - + [f (m+1 ,n) - + [f (m,n+l ) - Sj^^n+1^ 

+ [f(m+l,n+D - 

= ^ ^ ■ Vl ,n^^ ■ ^ra,ntl 


+ (a + b + c-S^+1^„+l) . 


(A2) 


The necessary conditions for the least square error are 



(n,m+l) (m+l,n+l) 



Figure A. Relationship between new grid point (j,k) and its four 
neighboring original grid points. 





»-^=0 . 
» a 


1^=0 and|^=0; that is. 


2a + b + 2c = , 


a + 2b + c = , 


2a + 2b +4c = S +S jt+S.*, +s., ,, 

m,n ^m,n+l %+) ,n m+1 ,n+1 


Solving equations (A3), (A4), and (A5), gives 


^ ~ I ^Ti+l,n+1 ^m+l,n " ^nisn+l- " 

" F ^Vl,n+1 * \,n+1 ■ Vl,n ‘ 


" t^'Vl,n+l ^m,n+l ■*■ Vl.n ' 


Substituting equations (A6), (A7), and (A8) into equation (Al), the 
equation of the least-square^error interpolation plane is obtained as 

f(x',y‘) = (^)(S^+i^n +1 + - S|j|^^)(x' - m) 

^F^^Vl,n+l) * ^ra,n+l ‘ Vl,n ' ‘ 

^l^^"Vl,n+l ■*■ ^ni,n+1 * Vl,n + 3S„ „) . 


Hence the desiped value at {x.,y. ), or (j,k) is 


iL 


f(j>k) = myy^) = 2 ^Vl,n+l‘*‘ Vl,n" Vn+l " 

**' F ^^m+1 ,n+l *** ^m,n+l " ^m+1 ,n " ^m,n^ 

*** \ ,n+l ■*■ ^m,n+l Vl ,n ^ ^m,n^ • 
Equation (AlO) can be v/ritten as 


where 


^ ^Wl jH+l^m+l >n+l s 


= - 1 ^ <iy + J- , 


m+ljU+l F 


= 1 Ax + i <^y - 1 


The W's are the weights of the values at the four grid points with 
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APPENDIX B 

DERIVATION OF THE THREE-STEP 
SLIDE ALGORITHM 
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The success of the slide algorithm devised in Chapter 6 is due to 
the fact that the V-pattern is automatically aligned after Steps 1 and 2. 
This allows for the completion of the slide procedure by simply sliding 
the image columnwise as described in Step 3. The following is devoted 
to explain and to prove the essence of this algorithm. Equations (35) 
and (36) for the Assigning Technique are used for the derivation. 

Step 1 

Assume that element (m,n) is within the same H-zone as (PjPq), 
which is an element at the same column as the rotation center (psq), as 
shown in Figure B; in other words, their H values are equal, 

where Hq and H are given by equations (34) and (36) » 

Hq = <(nQ-q) s1ne> 
and 

H = <-(l-cose)(m-p) + (n-q) sin9> , 


Therefore, 

<(np-q) sin6> = <-(l-cose)(m-p) + (n-q) sine> . (El) 

As shown in Figure B, more than one element at the p-column may lie 
within the same H-zone as (m,n), Thejij^ values corresponding to these 
points are spaced by a value of sin a, Therefore, at least one of these 
points can always be chosen as the (p,ng) point corresponding to this 
(m,n) point, such that, dropping the "round-off function", equation (Bl) 



Figure B. Amount of H-pattern iining-up slides. 


m 


becomes 


or 


(iiQ-q) s1n9 = -(l"Cos0)(m-p) + (n-q) s1n9 + E{sine}j 


. (tiQ-n) sine = (cose-l)(in-p) + E{s1ne} , 


(B2) 


where E{sin0} is an error term of magnitude less than sine. Dividing 
both sides of equation (B2) by sin 6 yields 


or. 


(n -n) = icose^l ^ j + Et|M> . 
0 ' sine sine > 


(ng-n) = - ( S Pse-1) („_p) + ^ 


(B3) 


where E{1} is an error term of magnitude less than 1. 

Observe that in order to align the H-pattern, the (m.n) point needs 
to be slid up by an amount V = n^ - n such that (p.np) and (m,n) will be 
at the same horizontal position. Since the amount of the slides has to 
be an integer, the amount of vertical slide in Step 1 can be chosen as 




(B4) 


With this amount of H-pattern slides, any two points, say (nipn-j) 
and will be slid vertically in Step 1 by 

V (m,-p)> (B5) 

and 
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V 


2 


^\^cds6-l 
" sine 


(m2-p)> , 


respecti vely, 


(B6) 


St-2p 2 

Once the H-pattern is aligned, these two points are to be slid 
horizontally by the amount given by equations (34) and (36). 

s < -(l-cos0)(mi-p) + (n^-q) s1n0> (B7) 

and 

H2 = < -(l-cos0)(ni2-p) + (n2*-q) sina> , (B8) 

respectively. 

Originally element is at column m^ . After being slid 

horizontally by the amount in this step, this element is now at the 
col umn 

= m^ + <-Cl-cos0){ra^-p) + (n^-q) sine> , (B9) 

Similarly, element (m2jn2) is now at the column 

mg + Hg = m2 + <-{l-cos0)(m2-p) + (og-q) sin0> . (BIO) 
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Step 3 

What remains to be proven is that the V-pattepn is aligned after 
Steps 1 and 2; in other words, any two elements at the same column will 
now hav'e the same value of V, 

Let (m-|,n^) and (rngjOg) be at the same column after Steps 1 and 2, 

m-| **• H-j = m2 + Hg ; 

or, from equations (B9) and (BIO), 

+<-(l-cose)(mi-p) + (n-j-q) sine>= m2 + <-(l-cose)(m2-p) + (n2“9) sin0> . 

Dropping the round-off functions subject to a round-off error of the 
fractional part, the above equation becomes . 

m-jCose + n-|Sin0 = m2COse + ngsine . (Bll) 

The total amount of the vertical slide to be made for elements 
(mpn-j) and (mgsOg) is given by equations (33) and (35), 

V;j = <-(l-cose)(n^-q) - (m-j-p) sine > 
and 

Vg = <-O-cos0)(n2-q) - (jUg-p) sine> , 
respectively. 

Since these two elements have already been slid vertically in 
Step 1 by the amounts V-| ' and VgS respectively, the remaining amount of 
the required vertical slide for (m-j,n^) is 
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'^l" ^ ^ <-(l“CO£0)(n-j-q) - (nii-p)sin 0>-<^P^(mi-p)> 

Again, dropping the round-off functions subject to a round-off error of 


the fractional part gives 

Vi' = T° ' nV ' t(in-]-p) cose + (n^-q) sine} . (B12) 

Similarly, for point (mg.ng), 

Vg" = {(ntg-p) cose + (Hg-q) sine} . (B13) 

From equations (B12) and (B13) 

V}" - Vg" = {(niTitig) cose + (n-j-ng) sine}. (B14) 

Substituting equation (B11) in equation (B14) gives 

Vy - Vg" = 0 , (B15) 


which means that (misn-j) and (m 2 jn 2 ) at the same column after Steps 1 and 
2 require the same amount of vertical slide. 

Notice that the above derivations are subject to the round-off 
errors, which result in the differences of magnitude 1 as shown in the 
example in Chapter 6. Extraction of the data is presented in Chapter 7 to 
take care of these differences, 
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DIMENSION XJ(32t32)*VK(32,32),NVP(32)»NH£32),NVPPC32) 
INTEGER’5'2 OUTBND»M(32,32) tN! 32# 321 ,MFC32 ,32) tNF(32»32)» 

$ IM132»32I#SMN(32,32I 

INTEGER P»Q 

DATA OUTBND/* SHN/1024’5'0/ 

C 

ORIGINAL POSITION (M,N) 

c 

DO 1 I=a»32 
DO 1 J=a,32 

1 NCI,J)=^J-1 
DO 11 K=l»32 
J=33-K 

C WRITE OUT THE ORIGINAL COORDINATES 

11 WRITE(6,I00) (Mil, J) ,1=1,32) 

WRITE(6,200) 

200 FORMAT!' !• ) 

00 12 K=l,32 
J=33“K 

12 WRITE(6,100) CNI I, J1 ,1=1,32) 

100 F0RMATC1X,32<I2) ) 

WRITEI6,. .0) 

C 

0****>J:«** read in AND WRITE OUT IMAGE 

P,Q: COORDINATES OF ROTATION CENTER 
TETt ROTATION ANGLE 

LLL=l! USING ASSIGNING TECHICLQCKWISE ROTATION) 

LLL=2: USING ASSIGNING TECHICOUNTER-CLOCKWISE ROTATION) 
LLL=3: USING LLSE TECHICLOCKWISE ROTATION) 

LLL=4: USING LLSE TECHICOUNTER-CLOCKWISE ROTATION) 

DO 6 K=l,32 
J=33-K 

6 READ(5,300) CIMII , J) ,1 = 1 ,323 
300 F0RMATI32I1) 

REA0{5,310) TET,P,Q,LLL 
310 FORMATIFIO.6,12,12,1 1) 

DO T K=l,32 
J— 33“ K 

7 WR!TE(6,100) tlMU ,J3 ,1 = 1,32) 

WRITE(6,200) 

C 

final position (MF,NF) 

c 

C0STET=C0S{TET) 

SINTET=SIN(TET) 

DO 2 J=l,32 
DO 2 K=l,32 

XJ( J,K)=FLOAT(MU,K)-P)«COSTET-FLOAT(NU,K)-Q)^SINTET 
$ +FL0AT(P) 


YK< JfKl=FLOATrH( K.);'-*P>’^SlNTET+FLOATiNlJf KI-Q)=^COSTET 
$ ■ -l-FtOATiQ) 

GO TOC2A,24r25«25),LLL 

FOR ASSIGNING TECHNIQUE 

24 IFIKJU>KKGE*-0.5I GO TO 21 
HFU9fU==INTlXJU»K)+0-5l-l 
GO TO 22 

21 RFC J»K)“INT(XJU»K)+0*5) 

22 IF{YKU»K).GE.-0-5) GO TO 23 
NFtJfK)=INT(YK(J,K)^-0.5)-l 
GO TO 2 

23 NFtJfK)*INTlYK(JfK)<-0.5) 

GO TO 2 

FOR LINEAR LEAST-SQUARE-ERROR TECHNIQUE 

25 IFiXJt J tK).GE.0*0) go TO 26 
HF(J,Kl=INT(XJU»Kn-l 

GO TO 27 

26 HF(J,K>=INT(XJUfKn 

27 IF(YKU»K5.GE.OoOl 60 TO 28 
NFUfK) = INT(YK{J|Kn-l 

GO TO 2 

28 NFU,K)=INT(YK(J,K)J 

2 CONTINUE , 

DEFINE THE BOUNDARY OF THE ROTATED IMAGE 

DO 3 J=lj32 

IFIMFI Jf K) «LT.0«0R-HF(J»K3 «G£«31.0R*NF( Jf lO.tT.O.OR. 
$ NFUtKI.GE.3lJ GO TO 31 
GO TO 3 

31 MF(JfK)=QUTBND 
NFUtKJ=OUTBND 

3 CONTINUE 

DO 32 K=l,32 
J=33-K 

32 WRITE{6»IG0J 
WRlTE(6f200) 

DO 33 K=lt32 
J=33-K 

33 WRITE(6«100) 

WRITEI6t200) 


(MFUtJJ»I=l»32J 


(NFUtJJ fl=lf 32 ) 


C>}t**5{e**#3?c STEP 1 

Q 

CALL CQNTRKSINTETtCOSTETtPtQtNVP) 

C NVPtn: NUMBER OF VERTICAL SLIDES FOR COLUMN (U IN STEP 1 

DO 4 I=lt32 
K=NVPtn 

IFCK.GT.O) GO TO 46 
IFIK.LT.05 GO TO 47 
GO TO 4 
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C SLIDE UP 

46 KK=32-K 

DO 41 J=1,KK 
JJ=33-J 

M(I»JJJ=M(I,JJ-KJ 

N<I»JJ)=N(l5JJ-KJ 

41 IMn»JJ)=IM(I»JJ-K) 

DO 42 J=ljK 
M(ItJ)=OUTBND 

NC U J) = OUTBNO 

42 IM(I ,J)=OUTBND 
GO TO 4 

C SLIDE DOWN 

47 KK=32<-K 

DO 43 J=1,KK 
Mfl, J)=rM(I,j-K) 
N(I,J)=Nn,4-K) 

43 IM(If J>=IMCI,J-K) 

KK1=KK-H 

■ DO 45 J=KK1,32 
MCl,J)=OUTBND 
NCI,4)=:0UTBND 
45 IMdt JJ=OUTBND 
4 CONTINUE 
DO 44 K*I,32 
J=33-K 

44 WRITE{6,100) (IM{I » J J , I«l t32 J 
WR!TE16,200) 


STEP 2 
C 


C 


c 


CALL C0NTR2{SINTET,C0STET,P,Q,NH,LLU 
NH(I)S NUMBER OF HORIZONTAL SLIDES FOR ROWC I 
DO 5 J=l,32 
K=NH(JJ 

IFIK^GT.O) GO TO 53 
IF(K*LToOJ GO TO 54 
GO TO 5 

SLIDE LEFT 
54 KK=32i-K 


DO 51 I=1»KK 
M( I,J)=M(r-K,J} 
N(I,J)=N(I-KrJ) 

51 IM{ I, J)=IM{I-K,J) 
KK1=KK+1 

DO 52 I=KK1,32 
H( If J)=OUTBNO 
Ndf J)=OUTBND 

52 IM(I,J)=OUTBND 
GO TO 5 
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C SLIDE RIGHT 

53 KK=32-K 

00 82 I*lfKK 
11=33-1 

MCIIf JI = Mtn-K,Jl 
N(IIfJ)=N(II-K,JJ 

82 IM(n,JJ = IHni-K#Jl 
00 83 1=1»K 

Mllf JMOUTBNO 
Nn»J)=OUTBND 

83 IMn,J)-OUTBND 
5 CONTINUE 

DO 81 K=l*32 
J=33-K 

81 WRITEl6f 100) UMd ,J)# 1 = 1*32) 

WRITE(6,200) 

C 

STEP 3 *♦*#*«** 

^ CALL CQNTR3(SINTET,CQSTET,P*Q*NVP,NVPP*LLL) 

C NVPPtns NUMBER OF VERTICAL SLIDES FOR COLUMNd) IN STEP 3 
DO 10 1=1*32 
K=NVPP(I ) 

TFCK.GT.O) GO TO llO 
IF(K,LT.O) GO TO 111 
GO TO 10 

C SLIDE UP 

110 KK=32-K 

DO 101 J=1*KK 
JJ=33-J 

HU,JJ)=Md*JJ-K) 

N(l*4J)=Ndf JJ-K) 

101 IM(I»JJ)=IM(I,JJ-K) 

DO 102 J=l*K 

M( I* J)=OUTBND 
N( I* J)=OUTBND 

102 IMd,J) = QUTBNO 
GO TO 10 

C SLIDE DOWN 

111 KK=32+K 

DO 201 J=1*KK 
M(I*J)=Md* J-K) 

Nd* J)=Nd,J-K) 

201 IMd,J) = IMn*J-K) 

KK1=KK+1 

DO 202 J=KK1*32 
M( T* J)=OUTBNO 
Nd* J)=QUTBND 

202 IMd »J)=OUTBND 
10 CONTINUE 


120 


DO 203 K*l,32 
«J— 33““K 

203 WRITE(6,100J « IMU t J ) 1 1=1 »32) 

WRITE(6f200) 

00 204 K=lf‘^2 
J=33-K 

204 WRITE16. ‘ )0) C ) »I = 1*32) 

WRiTE(<'e-/on: 

DO 20'.' 

205 WRITEtJrvUUw ■: N I , J) »I = l »32 1 
WRITE'; 

c 

EXTI^V"',' data and generate SMN 
c 

DO 30 I=l»32 
DO 30 J=lf32 

IFIMFt I, J) -LQ-MI I ? J) •AND.NFUt J) .EQ.N{ I* JJ) GO TO 301 
GO TO 30 

301 

30 CONTINUE 

00 40 I=l»3I 
DO 40 J*l»32 
1 1=1 + 1 

IF(MF(It J)«EQ.M( Ilf J>*AND*NFlItJ>«EQ»NtIlf JJ > GO TO 401 
GO TO 40 

401 SHNir, J)=IMtIlf J) 

40 CONTINUE 

DO 50 1*2,32 
DO 50 J*l,32 
11*1-1 

IFIMFtlf JI.EQoMC IltJUAND.NFdf JI®EQ*N(I1,JJ ) GO TO 501 
GO TO 50 

501 SMNI I, J)=IM{ Ilf J1 
50 CONTINUE 

DO 60 1=1,32 
DO 60 J=l,31 
J1=J+1 

IFCHFdf JI-EQ-Mt I,Jl),AND«NF(I,JUEQ.N(I,JU ) GO TD 601 
GO TO 60 

601 SMNU,J) = IM(If Jl> 

60 CONTINUE 

DO 70 1=1,32 
DO 70 J=2,32 
Jl=J-l 

IF(MFn,J)-EQ»Mn, JIJ.AND.NFI I, Jl.EQ.NdtJin GO TO 701 
GO' TO 70 

701 SMNd, J)=IMd, Jl) 

70 CONTINUE 
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DO 80 1=1,31 
DO 80 J=l,31 
U=I+1 
Jl=J+l 

IFtMF(I,J).eQ.M(Il,Jll.AND.NFn,J).EQ.NUl,Jl)) GO TO 801 
GO TO 80 
801 SMNC I, 

80 CONTINUE 

DO 90 1=2,32 
DO 90 J=2,32 
11 = 1-1 

IF(MF{ I,J).EQ,M(Il,Jl).AND.NF(I,J5,EQ*N{Ii,Jl)) GO TO 901 
GO TO 90 

901 SMN( I, JI=IH(I1,J1J 
90 CONTINUE 

DO 1000 1=1,31 
DO 1000 J=2,32 
Il=I-M 
Jl=J-l 

IF(MF( I,J)«EQ.MU1,J1).AND.NF(I, J)*EQ.N(I1,J1)I GO TO 1001 
GO TO 1000 

1001 SMNd, J)=IMni,Jl) 

1000 CONTINUE 

DO 2000 1=2,32 
DO 2000 J=l,31 
11 = 1-1 
J1=J-M 

IF|MFn,J).EQ-Mtil,JlI.AND.NF(I,J)<.EQ.N(U,Jl>) GO TO 2001 
GO TO 2000 

2001 SMNU,J)=IMni,JlJ 
2000 CONTINUE 

DO 2002 K=l,32 
J=33-K 

2002 WRITE(6,100) ( SMN ( I , J ) , 1=1, 32) 

WRITEt6,200) 

STOP 

END 
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SUBROUTINE CONTRl ( SINTET »COSTET, P, Q, NVP > 
C 

CONTROL OF STEP I 
C 

DIMENSION VPC32) *NVP(32) 

INTEGER P»Q 
DO 10 1=1,32 

VP{ I )=-{ l.O-COSTETI’f'FLOATI I-l-P> /SINTET 
IFIVPC IKGE.-0a5) GO TO XI 
NVPCn=INT(VP(n-*-0«5)-l 
GO TO 10 

11 NVPCn = INT{VPn)^0.5l 
10 CONTINUE 
RETURN 
END 


SUBROUTINE C0NTR2(SINTET,C0STET,P,Q, NH,LLLI 
C 

CONTROL OF STEP 2 
C 

DIMENSION H(32),NH(32) 

INTEGER P,Q 

GO TO(22,22t23,22I ,LLL 

22 DO 20 1=1,32 
HU)=FL0ATn-l“Q)*SINTET+0,5 
IFCHU I.GE.0.0) GO TO 21 
NHCr )=INTCHt I) )-l 

GO TO 20 

21 NH( I) = INTCHI in 
20 CONTINUE 
GO TO 24 

23 DO’ 30 1=1,32 
Hm=FL0ATn-l-Q)*SlNTET*-0o5 
IFlH(inGE.0*0) GO TO 31 
NHm = INT{H{in 

GO TO 30 

31 NH( I ) = INT[Hm)-H 
30 CONTINUE 

24 RETURN 
END 
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SUBROUTINE C0NTR3(SINTET,C0STETfP.QtNVP»NVPP,LLU 
C 

c*^**>{'*«* CONTROL OF STEP 3 
C 

DIMENSION VDI325 ,HD(32) t NVDI 32) , NHDC 321 t NVPP ( 32 ) »NVP(32) 
INTEGER P,Q 
DO 30 1=1,32 
GO T0(33, 34, 33,34), LLL 

33 J=I 

GO TO 35 

34 J=33-I 

35 von )=*( l-0-CQSTET)*FL0AT( J-l*QI-FL0AT(I*l-P)*SINTEH-0.5 
HD( I )=-{ l.O-C0STET)’!'FL0AT{ I-l-P) +FLOAT( J-1~Q)=5=SI NTET<-0.5 
IFIVDC D.GE.0.0) GO TO 31 

NVDn)=iNT{yDmi-i 
GO TO 32 

31 Nvo(n=iNT(vonn 

32 IF(HDm.GE.O.O) GO TO 23 
NHD( I)=INTCHO( n )-l 

GO TO 30 

23 NHD{ I)=INT(HD(in 
30 CONTINUE 

GO T0(51,51,52,53) ,LLL 

52 00 10 1=1,32 
NHD(I)=NHDm>l 

10 CONTINUE 
GO TO 51 

53 00 20 1=1,32 
NVDm=NVD(I )4-l 

20 CONTINUE 
51 TIL=0 
C 

DO 40 1=1,32 
II = H-NHD(II 
IFIII.LT.l) GO TO 40 
IFCIUGT.32) GO TO 61 
C FILLING NVPP 

43 IFni-UL-l) 41,41,42 
42 NVPPir IL+U=NVPPCI ID 

IIL=IIL+1 
GO TO 43 
C 

41 Nvppni}=NVDm-NVP(n 
IFdl.EQ^l) GO TO 46 
C SMOOTHING NVPP 

GO T0I44,45,44,45) ,LLL 

44 IF(NVPPni) .GT.NVPPm-U) NVPP ( 1 1 ) = NVPP ( II- 1 1 
GO TO 46 


45 IFCNVPPCin.LT.NVPPC II-D) NVPPnn=NVPP(n-ll 
GO TO 46 

48 IFU.EQ,32.AND.II.NE*32) GO TO 47 
GO TO 40 

47 NVPPdn-lJ^NVPPdl) 
n=n<-i 
GO TO 48 

46 llL-ll 

40 CONTINUE 

61 IFdIL*EQ.32) GO TO 49 
NVPPd IL+ll=NVPPdIL) 

HL=nL4-l 
GO TO 61 

49 RETURN 
END 
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